🕷️️ Job Radar • SCRAPING

upwork.com 2026-04-18 🟡

🔹 Build a Python-based System for Monitoring UK Planning Applications
👤 Client: undefined GBR Member since 2026-04-08
💰 Price: ****
🚩 Problem: Automate the monitoring of planning applications from multiple UK council websites to identify potential leads early.
📦 Existing: Not specified

Specifications:

[Target] Monitor 2-3 initial councils, with scalability in mind for future expansion.
[Method] Use Python (BeautifulSoup, Scrapy, Selenium) for web scraping; handle dynamic sites and pagination.
[UI/UX] Not applicable - system will be command-line or API-based.
[Stack] Python, BeautifulSoup, Scrapy, Selenium, cron jobs, email/SMS notifications.
[Security] Ensure data privacy and secure handling of credentials (e.g., environment variables).
[Format] JSON for structured data storage; emails/SMS for alerts.

Workflow:

1. Define target council websites and their URLs.
2. Develop scraping scripts using Python libraries to extract relevant data.
3. Implement pagination handling and structure differences across sites.
4. Set up scheduled tasks (cron jobs) for daily checks.
5. Integrate email/SMS notification system for alerts.
6. Test the system with initial 2-3 councils.
7. Document the process for future maintenance.